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Abstract 

We investigate the nonparametric estimation for regression in a 
fixed-design setting when the errors are given by a field of dependent 
random variables. Sufficient conditions for kernel estimators to con- 
verge uniformly are obtained. These estimators can attain the optimal 
rates of uniform convergence and the results apply to a large class of 
random fields which contains martingale-difference random fields and 
mixing random fields. 
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1 Introduction 



Over the last few years nonparametric estimation for random fields (or spatial 
processes) was given increasing attention stimulated by a growing demand 
from applied research areas (see Guyon [T8]). In fact, spatial data arise in 
various areas of research including econometrics, image analysis, meterology, 
geostatistics... Our aim in this paper is to investigate uniform strong con- 
vergence rates of a regression estimator in a fixed design setting when the 
errors are given by a stationary field of dependent random variables which 
show spatial interaction. We are most interested in conditions which ensure 
convergence rates to be identical to those in the case of independent errors 
(see Stone [33j ) . Currently the author is working on extensions of the present 
results to the random design framework. Let Z d , d > 1 denote the integer 
lattice points in the (i-dimensional Euclidean space. By a stationary real 
random field we mean any family (£fc)fcez d °f real- valued random variables 
defined on a probability space (Q, J 7 , P) such that for any (k, n) G Z d x N* and 
any (i 1; ...,z n ) G (Z d ) n , the random vectors (e h , ...,e in ) and (e il+k , e in+k ) 
have the same law. The regression model which we are interested in is 



where g is an unknown smooth function and (Si) i( zi d is a zero mean stationary 
real random field. Note that this model was considered also by Bosq [8J and 
Hall et Hart (THJ for time series (d — 1). Let K be a probability kernel defined 
on M. d and (h n ) n >i a sequence of positive numbers which converges to zero 
and which satisfies {nh n ) n >i goes to infinity. We estimate the function g by 
the kernel-type estimator g n defined for any x in [0, l] d by 



Note that Assumption Al) in section 2 ensures that g n is well defined. Until 
now, most of existing theoretical nonparametric results of dependent random 
variables pertain to time series (see Bosq [9]) and relatively few generaliza- 
tions to the spatial domain are available. Key references on this topic are 
Biau 0, Carbon et al. [ID], Carbon et al. [H], Hallin et al. HU, [21], Tran 
|8i] . Tran and Yakowitz [HE] and Yao [HE] who have investigated nonpara- 
metric density estimation for random fields and Altman [2j, Biau and Cadre 
[El, Hallin et al. [22] and Lu and Chen [2E], [2E] who have studied spatial 
prediction and spatial regression estimation. The classical asymptotic theory 
in statistics is built upon central limit theorems, law of large numbers and 



Yi = g{i/n) + e h i 



G A n = {!,... ,n} d 



(1) 




(2) 
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large deviations inequalities for the sequences of random variables. These 
classical limit theorems have been extended to the setting of spatial pro- 
cesses. In particular, some key results on the central limit theorem and its 
functional versions are Alexander and Pyke [1], Bass [3j, Basu and Dorea 
[4J, Bolthausen [7J and more recently Dedecker [12], [13], El Machkouri [TH] 
and El Machkouri and Volny [17J. For a survey on limit theorems for spa- 
tial processes and some applications in statistical physics, one can refer to 
Nahapetian [28j. Note also that the main results (section 3) of this work 
are obtained via exponential inequalities for random fields discovered by El 
Machkouri [16J. 

The paper is organized as follows. The next section sets up the notations 
and the assumptions which will be considered in the sequel. In section 3, we 
present our main results on both weak and strong consistencies rates of the 
estimator g n . The last section is devoted to the proofs. 

2 Notations and Assumptions 

In the sequel we denote \\x\\ = maxi<k<d \xk\ for any x = (xi, ...,Xd) € [0, l] d . 
With a view to obtain optimal convergence rates for the estimator g n defined 
by (J2J), we have to make the following assumptions on the regression function 
g and the probability kernel K: 

Al) The probability kernel K is symmetric, nonnegative, supported by 
[—1, l] d and satisfies a Lipschitz condition \K(x) — K(y)\ < rj\\x — y\\ 
for any x, y G [— 1, l] d and some r] > 0. In addition there exists c, C > 
such that c < K(x) < C for any x G [—1, l] d . 

A2) There exists a constant B > such that \g(x) — g(y)\ < B\\x — y\\ for 
any x, y e [0, l] d , that is g is £>-Lipschitz. 

A Young function ip is a real convex nondecreasing function defined on M + 
which satisfies lim f ^ 00 ^(t) = +oo and if)(0) = 0. We define the Orlicz space 
L^p as the space of real random variables Z defined on the probability space 
(ft, J 7 , P) such that .E^dZl/c)] < +oo for some c > 0. The Orlicz space 
L^p equipped with the so-called Luxemburg norm ||.||^ defined for any real 
random variable Z by 

||Z||^ = inf{c>0; E[iP(\Z\/c)} < 1} 

is a Banach space. For more about Young functions and Orlicz spaces one 
can refer to Krasnosel'skii and Rutickii [21]. Let (3 > 0. We denote by ipp 
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the Young function defined for any x G M + by 

^(x)=exp((x + ^)' 3 )-exp(^) where & = ((1 - P)/P) 1/P l{o</?<i}- 

On the lattice 7h d we define the lexicographic order as follows: if z = (h, ■■■,id) 
and j = (ji, ...,jd) are distinct elements of Z d , the notation i <i ex j means 
that either i\ < ji or for some p in {2, 3, d}, i p < j p and i g = j q for 
1 < q < V- Let the sets {Vf ; i e Z d , k e N*} be defined as follows: 

Vi = {jeZ d ;j< lex i}, 

and for k > 2 

^ = ^i. 1 n {j e ^ d i N ~~ il ^ ^} where |i — j| = max |ij — 

l<Z<d 

For any subset T of Z d define jF r = cr(^ ; % G T) and set 

S| fc |(ei) = S(e< 1^ j*, ), keV*. 

i 

Denote (3{q) = 2q/ (2—q) for < q < 2 and consider the following conditions: 
CI) e G L°° and 



^2 W^kE\k\{£o)\\oo < oo. 



C2) There exists < q < 2 such that e G and 

2 

< OO. 



\\y\ £ k E \k\(eo) 



C3) There exists p > 2 such that Eq G L p and 

lkfc^|fc|(£o)||f < oo. 

C4) £ G L 2 and Y^k& d l-^( £ o£fc)| < 00 • 

Remark 1 Note that Dedecker |l2j established the central limit theorem 
for any stationary square-integrable random field (sk)kei d which satisfies the 
condition Y.k&v 1 ll £ ft^|fc|( £ o)||i < oo. 
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In classical statistical physics, there exists spatial processes which satisfy 
conditions C1),...,C4). For example, Nahapetian and Petrosian (2H1 gave 
sufficient conditions for a Gibbs field (£k)kez d to possess the following mar- 
tingale difference property: for any i in Z d , E(£i\J-yi) = a.s. Another 
examples of random fields which satisfy conditions C1),...,C4) can be found 
also among the class of mixing random fields. More precisely, given two 
sub-cr-algebras U and V of J 7 , different measures of their dependence have 
been considered in the literature. We are interested by two of them. The 
a-mixing and 0-mixing coefficients had been introduced by Rosenblatt [SI] 
and Ibragimov (2H] respectively and can be defined by 

a(U,V) = sup{|P(tfnV) -P(t7)P(V)|, U G U, V G V} 

<Ku,v) = su P {||p(y|^) -P(y)||oc, v g v}. 

We have 2a(U, V) < (f>(U,V) and these coefficients equal zero if and only if 
the a- algebras U and V are independent. Denote by jjr the cardinality of any 
subset T of Z d . In the sequel, we shall use the following non-uniform mixing 
coefficients defined for any (k,l,n) in (N* U {oo}) 2 x N by 

ock,i{ n ) = SU P {a(^ri,^r 2 ), tl r i < k, %T 2 < I, p(ri,r 2 ) > n}, 

4>kA n ) = sup{0(JTx,^T2), tl r i < k, tjr 2 < i, p(r 1 ,r 2 ) > n}, 

where the distance p is defined by p(Fi,r 2 ) = min{|i — j\, i G T\, j G r 2 }. 
We say that the random field (£k)kez d is a-mixing or 0-mixing if there exists a 
pair (k, I) in (N* U {oo}) 2 such that lim^oo a^i{n) = or lim n _ +oc 4>k,i( n ) = 
respectively. For more about mixing coefficients one can refer to Doukhan 
|1F)J . We consider the following mixing conditions: 

C'l) e G L°° and 

^ 0oo,l(|&|) < OO. 

C 2) There exists < q < 2 such that Eq G L^.. and 

5^ \J (t>oo,i{\k\) < oo 

kei, d 

or 

k& d 

where for any (3 > 

cM = inf |c> | ^ ^QfM^j du < i J . ( 3 ) 
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C 3) There exists p > 2 such that e G L' p and 

^ / riMW) \ 2/p 

/ Q P e (u)du) <OC (4) 

where Q £o is the inverse cadlag of the tail function t — > P([e | > (i- e - f° r 
any u > 0, Q £o (u) = M{t > 0|P(|e | > t) < u}). 

Remark 2 Let us note that if p = 2 + 5 for some 5 > then the condition 

oo 

m o!_1 a 1 2 ^ £ (m) < oo for some £ > 



m=l 

is more restrictive than condition (pEJ) and is known to be sufficient for the ran- 
dom field (£k)k&z d to satisfy a functional central limit theorem (cf. Dedecker 

HI). 

In statistical physics, using the Dobrushin's uniqueness condition (cf. |14j), 
one can construct Gibbs fields satisfying a uniform exponential mixing con- 
dition which is more restrictive than conditions CI), C 2) and C 3) (see 
Guyon [Ej, theorem 2.1.3, p. 52). 

3 Main results 

Let (Z n ) n >i be a sequence of real random variables and {v n )n>i be a sequence 
of positive numbers. We say that 

Z n = O a . s . [v n \ 

if there exists A > such that 

limsup - — — < A a.s. 

n^oo V n 

Our main result is the following. 

Theorem 1 Assume that the assumption Al) holds. 
1) // CI) holds then 

"(logn) 1 / 2 



sup \g n (x) - Eg n (x) \ = O a . s 

x£[0,l] d 



{nh n y/ 2 



(5) 
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2) // C2) holds for some < q < 2 then 



sup \g n (x) - Eg n (x)\ = O a , 

xG[0,l] d 



(log n 



,1/9 



(nh n ) d ' 2 



(6) 



3) Assume that C3) holds for some p > 2 and h n = n 02 (log n) dl for some 
61,62 > 0. Let a, b > 6e /jxec? and denote 

n a (\ogn) h n 2a(d + p)-d 2 -2 

Vn = l^W and e = — dWTJ) — • 

Ifd>6 2 and d{3d + 2)6 l + 2(d + p)6 > 2 /nen 



SUp \g n {x) - ^n^)! = O a . s . [v n ] . 
xG[0,l] d 



(7) 



Remark 3 Theorem [2 shows that the optimal uniform convergence rate 
is obtained for bounded errors (cf. estimation (jSJ)) and that it is "almost" 
optimal if one considers errors with only finite exponential moments (cf. 
estimation Q). 

Theorem 2 Assume that the assumption Al) holds. 
1) Assume that C3) holds for some p > 2. Let a > be fixed and denote 



n 



n {nh n yn 

If 6 > and h n > rT d then 



and 6 



sup \g n (x)- Eg n {x) 

x&[0,l] d 



2a(d + p) - d 2 
d(3d + 2) 



0[v n ] 



(8) 



2) If C4) /iotas tfien 



sup \\g n (x) - Eg n (x)\\ 2 = O [(nh n ) d/2 ] 
xe[o,i] d 



(9) 



In the sequel, we denote by Lip(B) the set of .B-Lipschitz functions. The 
following proposition gives the convergence of Eg n (x) to g(x). 

Proposition 1 Assume that the assumption A2) holds then 

sup sup \Eg n (x) - g(x)\ = O [h n ] . 
ze[o,i] d ge Lip(B) 
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From Proposition [2 and Theorem Q] we derive the following corollary. 
Corollary 1 Assume that Al) and A2) hold and let h n = (n~ d log n) 1 ^ 2+d - ) . 



1) 7/ CI) /iotas tfien 



sup sup \g n (x i 

x£[0,l] d ge Lip(B) 



- g(x)\ = o a „ 



logn 



rr 



i 

2+d 



2) 7/ C2) /iotas /or some < q < 2 i/ien 



sup sup |£f n (x) -fl-(x)| = O a . s . 

c€[0,l] d g£ L«p(-B) 



u\n) 



log n\ 2+d 



n u 



where u(n) = (logn)^ 2 *?)/2g_ 
3) Let e > be fixed. If C3) holds for some p > 2 satisfying 

4d 3 + (4 - 2e)c/ 2 + (2 - 4e)d + 4 



P 



> 



2e(2 + d) 



then 



sup sup \g n (x) -g(x) \ = O a „ 

x£[0,l] d g£ Lip(B) 

where u{n) = rf . 



u(n) 



logn 



n" 



2+d 



(10) 



(11) 



(12) 



(13) 



Remark 4 Note that the consistency rate (n d logn) 1 ^ 2+d ^ > is known to be 
the optimal one (see Stone [33J). 

From Proposition [2 and Theorem El we derive the following corollary. 
Corollary 2 Assume that Al) and A2) hold and let h n = n ~ d /( 2 + d ) . 
1) LeZ e > be fixed. If C3) /iotas for some p > 2 satisfying 

4rf 3 + (4 - 2 £ )c/ 2 - 4aZ 



2^(2 + d) 



then 



sup sup |# n (xJ - g{x) 

x£[0,l] d g£ Lip(B) 



o 



n 



(14) 



(15) 



2) If C4) holds then 



sup 

x£[0,l] d 



sup \g n (x) - g(x)\ 

gS Lip(B) 



o 



d_ 

n 2 + a 



(16) 



Finally the rates of convergence obtained above are valid when the errors 
are given by a mixing random field. More precisely, we have the following 
corollary. 

Corollary 3 Theorems Q and [H and Corollaries Q and [H still hold if one 
replace conditions CI), C2) and C3) by conditions C 1), C 2) and C 3) 
respectively. 



4 Proofs 

For any x in [0, l] d and any integer n > 1 we define B n (x) = Eg n (x) — g(x) 
and V n (x) = g n ( x ) — Eg n (x). More precisely 

Bjx) = A m / } - g{x) 



V n {x) 



SieA n a i\ x ) 
^2ieA n a i( x ) £ i 



where ai{x) = K y ^f j • In the sequel, we denote also S n (x) = J2ie\ n a i( x ) £ i 
for any x G [0, l] d . We start with the following lemma. 

Lemma 1 There exists constants c, C > such that for any x G [0, l] d and 

any n G N* , 

d d 

c\\[n(x k + h n )\ < a i( x ) < CY[[n(x k + h n )\ (17) 

k=l «6An k=l 

where [ . ] denote the integer part function. 

Proof of Lemma^ Since the kernel K is supported by [—1,1], we have 

[n(xi+h n )] [n(x d +h n )] 
ieA n ii=l i d =l 

By assumption, there exists constants c, C > such that c < K(y) < C for 
any y G [—1, l] d . The proof of Lemma[T]is complete. 
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4.1 Proof of Theorem [T] 



Let (v n ) n >i be a sequence of positive numbers going to zero. Following 
Carbon and al. [H] the compact set [0, l] d can be covered by r n cubes I k 
having sides of length l n = v n h 2dJrX and center at c k . Clearly there exists 
c > such that r n < c/l d . Define 

A hn (g) = max sup \g n {x) - g n {c k )\ 
l<k<r n x( z Ik 

A 2 , n {g) = max sup \Eg n (x) - Eg n (c k )\ 
l<k<r n xe i k 

A 3i1l = max \g n (c k ) - Eg n (c k )\ 

l<k<r n 

then 

sup \g n {x) - Eg n (x)\< sup [A ltTl (g) + A 2>n {g)) + A 3jTl . (18) 



Lemma 2 For i — 1,2 we have 

sup A ijn (g) = O a . s . [v n ] . 

g€ Lip(B) 

Proof of Lemma\B Since g G Lip(5), we can assume without loss of gener- 
ality that g is bounded by B on the set [0, l] d . For any x G I k , we have 



where 



and 



9n{Xj ~ g n {Ck) =0-i+0- 2 



Now, by Lemma[T]and Assumption Al), we derive that there exists constants 
c, rj > such that for any n sufficiently large 



and 

4 d r]n d l n /h n 



\ a 2\ < 



c 2 (nh 



2d 

n ) 



«eAn \ «eA„ / 
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Since (e$) is a stationary ergodic random field the lemma easily follows from 
the last inequalities and the Birkhoff ergodic theorem. The proof of Lemma 
[2] is complete. 

Lemma 3 Assume that either CI) holds and v n = (log n) 1 / 2 / \nh n ) d / 2 or 
C2) holds for some < q < 2 and v n = i\ogn) l / q / {nh n ) d / 2 then 

M,n = O a . s . [V n ] 

Proof of Lemma Let < q < 2 be fixed. We consider the exponential 
Young function define for any x G M + by ip q (x) = exp((a; + — exp(^) 
where = ((1 - q)/q) 1/q l{o< 9 <i}- Let A > and x G [0, l} d be fixed 

P(|K(x)| > \v n ) = P I \S n (x) \ > Xv n <n(x) J 

< (1 + e^ q ) exp 
For any i G A„ and any < q < 2 denote 

b i>q (a(x)e) = \\ai(x)£i\\ 2 + ^ ^\a k (x)ekE\ k _i\(ai(x)ei)\ (19) 

and 



^(q) 



6i )2 (a(a:)e) = Ha^x)^)^ + ||a fc (ar)e fc £7| fc _ i |(a i (ar)e i )|| 00 (20) 

kevl 

where = {j 6 Z d ; j <; ea; z}. Using Kahane-Khintchine inequalities (cf. 
El Machkouri |16) . Theorem 1) we derive that if Condition C2) holds for 
some < q < 2 then 



F{\V n (x)\ > \v n ) < (1 + e**) exp 



a/2 + ^ 



M(£, eAn M«(^)) 1/2 



(21) 

where M is a positive constant depending only on q and on the probability 
kernel K. Now using the definition (fTH|l and Lemma [T] there exist constants 
c, M > such that 



sup P(|K(x)| > Av„) < (1 + e^) exp 

xG[0,l] d 



< (1 + e e ' 



exp 



Xv n (EieAggj^)) 
M 

c 9 A 9 <([n/i n ]) d9 / 2 



1/2 
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So if v n = {logn) l / q /(nh n ) d / 2 and n is sufficiently large then 

c q X q log n 



sup P(|K(V)| > Xv n ) < (1 + e^) exp 

x£[0,l] d 



2 d i/ 2 Mi 



(22) 



If Condition CI) holds then (23} still hold with q = 2 (cf. El Machkouri [I 
Theorem 1). So if t>„ = (logn) 1//2 /(n/i n ) a! / 2 and n is large it follows that 



sup F(\V n {x)\ > Xv n ) < 2 exp 
xe[o,i] d 



c A log n 
2 d M 2 



(23) 



Since 



P(|i4 3 , n | > Xv n ) < r n sup F(\V n (x)\ > Xv n ), 

ze[o,i] d 

using (|22|) and (|23|) . choosing A sufficiently large and applying Borel-Cantelli's 
lemma, we derive 



and 



P ( limsup{|A 3in | > Xv n } ) =0 



P limsup 



< A 



1. 



The proof of points 1) and 2) of Theorem are completed by combining 
Inequality (fT8|) with Lemmas [2] and El 

Lemma 4 ylssMme t/iat C3) no/ds for some p > 2 and /i n = n^Qogn) 6 ' 1 
/or some 9i,9 2 > 0. Lei a, b > 6e /u;ed and denote 



n a (logn) 



and # 



2a(d + p) - d 2 - 2 



n (n/i„)<V 2 """" " d(3d + 2) 

If8>6 2 and d(3d + 2)6 1 + 2(d + p)b > 2 i/ien 

hm = (J a.s. 

Proof of Lemma^ Let p > 2 be fixed. For any A > 



F(\V n {x)\>Xv r , 



cii(x) 



< 



< 



\-PE\S n {x)\P 



p/2 



2p c ^ x ) 
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where = a^x) 2 ^!^ + a»(x) J2 keV i a k(x)\\£k E \k-i\(£i)\\z ■ The last es- 

timate follows from a Marcinkiewicz-Zygmund type inequality by Dedecker 
(see (THJ) for real random fields. Noting that there exists 7 > such that 
Ci(x) < jai(x), x G [0, l] d and using Lemma [H we derive that there exists 
7 > such that 

P (| As.nl > Xv n ) < r n sup P(|KO)| > ^n) < 



where r n = l d vP([nh n }) dp / 2 . Since v n = n a (log n) h /(nh n ) d > ' 2 and l n = v n h 2d+1 
it follows 

J_ {nh n )< d+ til 2 

r n ~ hi {2d+1) n a ( d +P\\ogn) b ( d +P\[nh n }) d P/ 2 ' 
If n is sufficiently large, we derive 

1 2 d Pl 2 {nh n ) d ^' 2 



r n hT d+1) n< d +P) (log nf^+P) (nh n ) d P/ 2 

2<ip/2 

~ h d(3d+2)/2 na{d+p y d 2 /2 ^ osn y {d+p) 
2dp/2 

- n (\ ogn )b(d+ P )+e 1 d(3d+2)/2 smce 6 - 9 * 

Now b(d + p) + 9id(3d + 2)/2 > 1 implies ^„>i T n X < °°- Applying Borel- 
Cantelli's lemma, it follows that for any A > 



P limsup{|A 3in | >Xv n }\ =0, 

\ n—>oo J 

that is for any A > 

P (limsupt^- < A) = I. 

The proof of LemmalUis complete and the point 3) of Theorem [T] is obtained 
by combining Inequality (fT8|) with Lemmas [2] and EJ The proof of Theorem 
[TJ is complete. 

4.2 Proof of Theorem [2] 

We follow the first part of the proof of Theorem [T] and we consider the 
estimation (fT8|) . 
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Lemma 5 Assume that C3) holds for some p > 2. Let a > be fixed and 
denote 

n a 2a(d + p) - d 2 

Vn ~ (nh n ) d /* d(3d + 2) " 

If 9 > and h n > rT e then 

||^3,n|| p = O [V n ] . 

Proof of Lemma\^ Let p > 2 and x G [0, l] d be fixed. Using the Marcinkiewicz- 
Zygmund type inequality by Dedecker (see [12]) as in the proof of Lemma H] 
there exist 7 , c > such that 

i/p 

I h I S A r)\i' \ 

\Vn(x)\\ p 



< 1" ( Y a ^ x ) J 

\ieA n / 

< ^= ( [nh n ] ) - d/2 by Lemma □ 



It follows that 



'c 



r)l v sup \\V n (x)\\ p = 

xe[o,i] d 



where r n = fj p v n (\nh n }) d l 2 . If ra is sufficiently large then r n > 2 
hence using /i n > rT e we obtain r n > 2~ d l 2 . Finally, we derive 



\A 3}n \\ p = || max |V;(x fc )|||p < r^ /p sup || || p = O [v n ] . 



Kk<r n 



The proof of Lemma El is complete. The point 1) of Theorem [2] is obtained 
by combining inequality (|T8f and lemmas [2] and EJ 

Now, we are going to prove the point 2) of Theorem El We have 
E(S n {x) 2 ) = Y a k (x) a l (x)E(e k e{) 

k,l£A n 

= Y a k {x) 2 E(e 2 k ) +^2a k (x)a l (x)E(e k e l ) 

keA n kj^l 

= E(e 2 ) Y a k( x ) 2 + Y a k(x) Y a i( x ) E ( £ k£i) 

keA„ k£A„ leA n \{k} 

< y \ E ( £ o£i)\ x Y ak ^- 
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If Condition C4) holds then using Lemma [T] there exists 7 > such that for 
any x e [0, l] d we have E{S n {xf) < l]\ d k=l [n{x k + h n )\. Let x E [0, l] d be 
fixed, using Lemma d there exists c > such that 

II Sn(x) || 2 



J2i£A„ a i( X ) 



< 



< 



< 



^ ( n^(^ + m 



-1/2 



c([nh n }) d / 2 



c(n/i n ) d / 2 
The proof of Theorem [21 is complete. 



for n sufficiently large. 



4.3 Proof of Proposition [T] 

Since g G Lip(.B), it follows that 

Y,ieA n (9(iM - g^a^x) 



\BJx) 



< Bh, 



SieA n a i{ x ) 

E»eA w Ui/n-x)/^^^) 

SigA„ a i{ X ) 



< Bh n . 

The proof of Proposition [T] is complete. 

4.4 Proof of Corollary Q] 

Let h n = {n~ d \ogn) l K 2+d ^ then Proposition Q] gives 



sup sup \Eg n (x) — g(x) \ = O 

x£[0,l] d g&Up{B) 



Assume that CI) holds. Noting that 

(log n) 1 / 2 ( log // "\ 



logn 



rr 



2 + d 



(nh n ) d / 2 



n" 



(24) 
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and using (pj we obtain 



sup \g n (x) - Eg n (x)\ = O a , 

x<E[0,l] d 



logn 



(25) 



Combining J2H) and we derive (fTU|) . 
Assume that C2) holds for some < q < 2. Noting that 
(logn) 1 ^ _ fl 0gn \£* x ( logn )(2-9)/a« 



(n/i n )<V 2 \ „" 
and using (j^J we obtain 



sup \g n (x) - Eg n (x)\ = O a , 



logn 



n" 



x (logn)^/ 29 



(26) 



Combining and (|2l)l) we derive {HJ. 



Let £ > be fixed and assume that C3) holds for some p > 2 which satisfies 
condition (fT2|) . Applying the point 3) of Theorem [T] with 9i = 1/(2 + d) and 
#2 — d/(2 + d) and noting that 



n a (logn) 

{nh n yn 



n 



logn 



a = e and 6 = - 
2 



it follows 



sup \g n {x) - Eg n (x)\ = O a , s . 

cG[0,l] d 



TV 



logn 



n" 



2 + d 



(27) 



Combining (|2~3| and (|2Tj) we derive (fTBl) . The proof of Corollary[T]is complete. 



4.5 Proof of Corollary [2] 

Let h n = n~ d '( 2+d > then Proposition Ogives 



sup sup \Eg n (x) 

xe[0,l] d gGLip(S) 



n 2+d 



Let e > be fixed and assume that C3) holds for some p > 2 which satisfies 
condition ifTljl . Applying the point 1) of Theorem El and noting that 



rr 



{nh n y/ 2 



n 2 + d 



+E 
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it follows that 



sup \g n {x) - Eg n (x) 

xG[0,l] d 



O 



n 2 + a 



(29) 



Combining (j2BJl and ^ we derive ijTTfl) . 



Since /i n = n" d /( 2+d ) then (n/i„) 



-d/2 



So, if C4) holds then combining 



(f28|) and (JHJ) we derive (fT6l) . The proof of Corollary [2] is complete. 



4.6 Proof of Corollary [31 

Let p > 2 be fixed. Using Rio's inequality j^Hl (see also Dedecker [TSj) we 
obtain the bound 



£*l,oo(|fc|) 



IMfa(eo)||*<4| / Q P ( u ) du ) 



(30) 



\ 2/p 

hence condition C'3) is more restrictive than condition C3). 

By Serfling's inequality (see McLeish [27] or Serfling |32|) we know that 

\\£kE\k\(so)\\oc < 2||£ O ||L0oo,i(l /i; l) 

so condition C I) is more restrictive than condition CI). 
Now for < q < 2 there exists C(q) > (cf. Inequality (17) in [TH]) such 
that 

' (31) 



J\e k E lkl (e )\ <C(q)J^{\k\). 
v Mi) v 



In |16| we used the following lemma which can be obtain by the expansion 
of the exponential function. 

Lemma 6 Let (3 be a positive real number and Z be a real random variable. 
There exist positive universal constants Ap and Bp depending only on (3 such 
that 

Ap sup < \\Z\\^ < Bp sup -^t/- 

Consider the coefficient Cfc(/3) given by Q and denote 

ra 1>oa (\k\) X 1/P 

,/,(/,) = J ^ Q p eo (u)du 



then the following version of lemma El holds. 



17 



Lemma 7 Let (3 be a positive real number. There exist positive universal 
constants Ap and Bp depending only on f3 such that for any k G 7* d 

Ap sup — w < c k {f3) < Bp sup — w . 

p>2 V 11 P>2 V ,P 

Now combining lemmas El and and inequality (|30|) there exists C (q) > 
such that 

^ <C'(q)cUf3(q)). 



£kE\k\(So) 



(32) 



Finally condition C 2) is more restrictive than condition C2) and the proof 
of Corollary El is complete. 
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